A METHOD FOR EFFICIENT HASHING OF DIGITAL CONTENT 

5 

FIELD OF THE INVENTION 

The present invention relates generally to communication systems 
and more specifically to digital rights management (DRM) related to accessing 
10 and processing digital information content. 

BACKGROUND OF THE INVENTION 

The popularity of digital content, such as MP3 music files, electronic 
15 games, DVD and MPEG movies, audio books, videos, electronic games, 
video clips, business data such as electronic mail and documents, is growing 
at a tremendous rate. Portable, wireless devices like pagers and mobile 
phones stand poised to make access to this digital content easier than ever. 
Content owners and providers, however, are concerned that the advent of 
20 such new devices will make digital content more susceptible to illicit copying 
and distribution. In order to avoid widespread piracy of valuable digital 
content, therefore, there is a need for secure methods for the distribution of 
electronic content that is not subject to abuse. 

Digital Rights Management (DRM) is a popular phrase used to 
25 describe the protection of rights and the management of usage rules related 
to accessing and processing digital information. These rights and rules 
govern various aspects of a digital object, such as who owns the object, how 
and when an object can be accessed and/or copied, and how much an 
object may cost. Content owners and providers hope to use a secure, 
30 tamper-resistant Digital Rights Management system, impervious to attack by 
would-be hackers, to enforce the rules associated with a digital object and to 
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protect the integrity of the digital object. It is important that hackers not be 
able to overcome the enforcement of these rules or alter the content 
associated with these rules. In particular, hackers should not be able to alter 
digital objects or their rules without detection. 

5 The problem of protecting digital objects and their associated usage 

rules is not straightforward. Hackers will likely have direct access to the 
digital objects and the rules. Objects and rules stored on a disk drive of a 
personal computer (PC), for instance, may be readily accessed by an editing 
M program. Since hackers may be able to easily change bits in the digital 

p 10 objects or associated rules, the Digital Rights Management system must be 
able to detect and report any such changes. This problem is exacerbated by 
the often large size of a digital object. Consider, for example, that 
compressed digital songs are typically 3 to 5 Mbytes and that DVD movies 
can be orders of magnitude larger. Verifying the integrity of such a large 
a is digital object can be very time consuming and inefficient. 

jji An approach that has been taken to authenticate the integrity of a 

digital object, whose component parts of content and usage rules may 
together be referred to as a content package, uses a digital signature to sign 
a cryptographic hash of the object. The following standard cryptography 
20 textbooks provide background information on data authentication solutions, 
including hashing, and are herein incorporated by reference: "Cryptography: 
Theory and Practice," by Douglas R. Stinson, CRC Press, 1995; "Applied 
Cryptography," by Bruce Schneier, 2 nd Edition, John Wiley & Sons, 1996. 

Referring now to FIG. 1, a pictorial representation 10 of one 
25 embodiment of this prior art approach is illustrated. Content 12 is encrypted 
by an encryption device 14 to provide a content package 16 having 
encrypted content 18 and a certificate of authenticity 20. In a preferred 
embodiment, the content is encrypted with a secret key to protect it from 
being used by anyone other than an authorized user. An authorized user 
30 would probably be a content purchaser, but there are other possibilities. The 
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encrypted content 18 is next cryptographically hashed to produce hash value 
Hash(EC), which is next placed into the certificate of authenticity CCert 20 
as indicated. The CCert certificate of authenticity can also contain additional 
information, such as the content's usage rules Rules, along with the content 
5 decryption key encrypted with the content purchaser's unit public key KuPub, 
or other important information. Finally, a trusted authority uses its private 
key CSK to digitally sign the certificate 20. 

There are also slightly different methods of hashing and encrypting 
content in the art. One of these is to first hash the content, append the hash 
10 to the content, and then encrypt the entire package. This provides excellent 
integrity checking, while the authenticity is harder to establish. Another 
method is to hash the content before encryption and to put that hash value 
into the certificate. The content is also encrypted. Authenticity of the 
content can only be verified after the content has been decrypted. 

15 Flow chart 30 of FIG. 2 illustrates this binding of the encrypted 

content to a rules certificate. At Block 32, the content is encrypted. At Block 
34, the encrypted content is hashed to produce a hash value Hash(EC). 
Next at Block 36, hash value Hash(EC) is placed into CCert certificate of 
authenticity and a trusted authority signs CCert certificate at Block 38. 

20 Verifying the authenticity of a content package is relatively 

straightforward and is illustrated in flow 40 of FIG. 3. At Block 42, the digital 
signature of the certificate of authenticity CCert is verified. If the digital 
signature is valid, as determined at Decision Block 44, then the next step, at 
Block 46, is to recalculate the hash of the encrypted content so that it can be 

25 compared to the originally calculated hash Hash(EC) that is part of the 
certificate CCert. This occurs at Decision Block 48. If the recalculated hash 
matches Hash(EC), then the content package is authenticated, at Block 50, 
and the content 12 can be decrypted and rendered. If the recalculated hash 
does not match Hash(EC), then the content package is not authenticated, as 

30 shown at Block 54. 
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A major shortcoming of this approach is that it requires that the hash 
of the entire content must be calculated before the digital object can be 
rendered. This can be prohibitively time consuming. As previously stated, 
the size of many digital objects, such as digital movies and songs, can be 
5 quite large. Consider, for example, that the estimated time to compute the 
SHA1 hash of a typical MP3 song, when using a 16 MHz MCore processor, 
is 15 to 20 seconds. A user of a content rendering device, such as a CD or 
DVD player, however, expects rendering to being almost immediately upon 
selecting one or more digital objects. 

O 10 In other possible prior art embodiments, it is still the case that the 

S hash of the entire content must be calculated before the content is 

CO authenticated. In these instances of the prior art, computing a hash is an all- 

was? 

g? or-nothing proposition. That is, the entire hash has to be calculated before 

any useful information is retrieved. 

IZ 15 In light of the foregoing, it can be seen that there is thus an unmet 

RJ need in the art to provide a more efficient method to detect changes in digital 

objects and their associated usage rules. 



20 



BRIEF DESCRIPTION OF THE DRAWINGS 



The novel features believed characteristic of the invention are set 
forth in the claims. The invention itself, however, as well as a preferred mode 
of use, and further objects and advantages thereof, will best be understood by 
reference to the following detailed description of an illustrative embodiment 
25 when read in conjunction with the accompanying drawings, wherein: 

FIG. 1 is a block diagram illustrating a method for binding content to a 
rules certificate, in accordance with the prior art. 

FIG. 2 is a flow illustrating a method of binding content to a rules 
30 certificate, in accordance with the prior art. 
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FIG. 3 is a flow illustrating a method for verifying authenticity of a 
content package, in accordance with the prior art. 

5 FIG. 4 is a flow illustrating the overall method of authenticating digital 

content, in accordance with a preferred embodiment of the present invention. 

FIG. 5 is a flow that illustrates a method of binding content to a rules 
certificate, in accordance with the present invention. 

FIG. 6 is a block diagram further illustrating the method of binding 
content to a rules certificate, in accordance with the present invention. 

FIG. 7 is a flow that illustrates a method of verifying the hash table of 
a content package, in accordance with the preferred embodiment of the 
present invention. 

FIG. 8 is a block diagram further illustrating the method of verifying 
the hash table of a content package, in accordance with the present invention. 

FIG. 9 is a flow that illustrates a method of verifying the hash of 
individual chunks or portions of encrypted content, in accordance with the 
present invention. 

25 FIG. 10 is a block diagram further illustrating the method of verifying 

the hash of individual chunks of encrypted content, in accordance with the 
present invention. 

FIG. 11 is a system block diagram illustrating how the generation and 
30 verification processes of the present invention can be used to ensure that an 
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authorized user device receives authenticated digital content, in accordance 
with the present invention. 

FIG. 12 is a block diagram illustrating how multiple layers of hash 
5 tables can be used in series for very large content, in accordance with the 
present invention. 

DESCRIPTION OF THE INVENTION 

10 While this invention is susceptible of embodiment in many different 

forms, there is shown in the drawings and will herein be described in detail 
specific embodiments, with the understanding that the present disclosure is to 
be considered as an example of the principles of the invention and not 
intended to limit the invention to the specific embodiments shown and 

is described. In the description below, like reference numerals are used to 
describe the same, similar or corresponding parts in the several views of the 
drawing. 

The present invention provides an efficient method for detecting 
changes in digital objects and their associated usage rules, and is particularly 

20 applicable to large digital objects in which verification that the object has not 
changed can be a very time consuming process otherwise. The present 
invention provides an efficient method to detect changes in digital objects and 
their associated usage rules. Rather than having to calculate the hash of the 
entire content package of a digital object before rendering content, during 

25 verification the hash is calculated incrementally and verified as the content is 
being rendered. 

Referring to FIG. 4, an overall flow 100 of the methodology of the 
preferred embodiment of the present invention is shown. At Block 110, an 
overall hash of a hash table, having a number of chunk hash entries 
30 corresponding to chunks of encrypted content, is calculated. As used herein, 
the term "chunk" refers to some portion, part, or section of the content. As will 
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be described later, the chunks are obtained by dividing the encrypted content 
into subparts, portions, parts or sections of the content; these chunks or 
portions need not necessarily by of the same length or size. Some of the 
many possible methods of dividing content into chunks include, but are not 
limited to, breaking the content into fixed length chunks, using content subtext 
to divide the content into chunks, and making chunk lengths dependent upon 
the position of the chunks within the content. Hashes of the chunks are 
stored as chunk hash entries of the hash table, and will be described herein in 
conjunction with Figures 5-6. 

Next, at some later time, verification of the hash table and 
subsequent verification of the chunks of the encrypted content if the hash 
table proves out, is performed. At Block 150, the authenticity of the hash 
table is verified by recalculating the overall hash of the hash table and 
verifying that it matches a previously calculated overall hash of the hash table. 
Next, assuming that the authenticity of the hash table has been proved at 
Block 150, at Blocks 180 and 190 the authenticity of a chunk of the encrypted 
content is verified. Authentication of a chunk allows that chunk to be 
immediately decrypted and rendered at Block 192 without the prior art 
requirement that the hash of entire content package be calculated first. For 
encrypted content, decryption of the chunk may occur in parallel to the 
hashing of the chunk in order to facilitate faster rendering of the chunk. 
Decision Block 194 ensures that every chunk to be authenticated is indeed 
authenticated. The two-stage verification process of Blocks 150 and 180 will 
be described in more detail in conjunction with Figures 7-10. 

Referring now to FIG. 5, Block 110 of Figure 4 for calculating an 
overall hash of a hash table having chunk hash entries corresponding to 
chunks of encrypted content is further described. At Block 112, the content is 
optionally encrypted, if so desired, and then divided into subparts or chunks at 
Block 114. At Block 116, a chunk hash is calculated for each chunk and 
stored in a hash table to create a plurality of hash table entries. From these 
hash table entries, which are simply the chunk hashes, an overall hash value 
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of the hash table is calculated at Block 118. At Block 120, this overall hash 
value of the hash table is added to a certificate that is signed by a trusted 
authority. 

It is also noted that those skilled in the art recognize that a digital 
5 signature is often viewed to include a hash function, thus the digital signature 
of the hash table data to create a certificate of authenticity can be performed 
directly on the hash table data without the intermediate step of calculating an 
overall hash. Of course, this scheme still encompasses the use of an overall 

H hash, in this case, however, the overall hash is viewed as part of the digital 

C3 

Q io signature scheme and not as a separate component. Thus, alternative 

m 

approaches such as this one are essentially analogous and are considered to 
I* be part of the present invention. 

i This approach is illustrated pictorially in conjunction with FIG. 6. 

j\ Content 12 is encrypted by an encryption element 14, corresponding to Block 

15 1 12. The encrypted content is divided into subparts or chunks 144 (shown as 

|rj Chunkl, Chunk2, Chunk3, Chunk4, Chunk5, Chunk6) that, together with hash 

H table 142 and CCert rules certificate 20, form the secure content package 

140; this corresponds to Block 114 of Figure 5. Next, cryptographic hashes 
146 of each chunk are calculated and stored as chunk hash table entries in 
20 hash table 142; this corresponds to Block 116 of Figure 5. The overall hash 
148 of the hash table entries, denoted as Hash(EC), is calculated at Block 
118 and at Block 120 the overall hash value is placed into certificate of 
authenticity CCert and the CCert certificate is digitally signed by a trusted 
authority. 

25 Next, the verification process of the present invention will be 

described in FIGs. 7-10. The flow of FIG. 7 expands upon the first step of 
verification, verification of the hash table 142, shown at Block 150 in FIG. 4. 
At Block 152, the overall hash of the hash table entries is recalculated. This 
recalculated overall hash value is then compared with the previously 

30 calculated overall hash Hash(EC) that is part of the CCert certificate of 
authenticity. If the recalculated overall hash matches the overall hash of the 
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certificate and if the digital signature of the CCert certificate is valid, as 
determined at Decision Blocks 154, 156 and 158, then the hash table and its 
binding to the usage rules is verified, indicated at Block 160. If, however, the 
recalculated overall hash does not match the overall hash stored in the 
5 certificate or if the digital signature of the certificate is not valid, then the 
authenticity of the hash table is not verified, indicated at Block 162. Since the 
overall hash is the hashing of the hashes of each of the chunks stored in the 
hash table, and is not the hash of the actual content, it can be calculated very 
M quickly. Moreover, hashing the hash table entries prevents would-be hackers 

10 from deleting, adding, rearranging, or otherwise changing the content chunks. 
Verification of the hash table 142 is also illustrated pictorially in Block diagram 
170 of FIG. 8. First, the overall hash 148 of the hash table entries 
Hash(Chunkl), Hash(Chunk2), Hash(Chunk3), Hash(Chunk6) of hash 
table 142 is recalculated; this corresponds to Block 152 of FIG. 7. Since this 
K is hash is not over the entire content, it can be quickly calculated. Next, this 
y overall hash must be checked to make sure that it agrees with the value in the 

m 

q certificate; this corresponds to Block 156 of FIG. 7. If the recalculated hash 

148 agrees with the certificate hash value, then the hash table 142 and its 
binding to the usage rules are verified, as shown in Block 160 of FIG. 7. 

20 The order of the above operations is not critical to practice of the 

invention. It is simply important that both verifications be performed. 
Therefore, it is just as valid to process Block 158 prior to performing the 
functionality of Blocks 152, 154, and 156. If the content passes both tests at 
Decision Blocks 156, 158, then its authenticity has been verified. If it fails 

25 either test at Decision Blocks 156, 158, then the content has failed the 
authenticity testing. 

Upon the successful authentication of the hash table, the hash of the 
individual chunks can be verified; this corresponds to Blocks 180-194 of FIG. 
4. Referring now to FIG. 9, verifying the authenticity of a chunk is illustrated. 

30 At Block 182, a hash of a selected chunk is recalculated to create a 
recalculated chunk hash of that chunk. At Decision Block 184, the inquiry is 
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whether the recalculated chunk hash matches the previously calculated chunk 
hash of the chunk. If yes, then the authenticity of the chunk is verified at 
Block 186. If not, then the authenticity of the chunk is not verified. And, 
referring back to FIG. 4, upon authentication of a chunk, that chunk can be 
5 rendered immediately at Block 192 without the requirement that the hash of 
the entire content be performed a priori. Of course, decryption of the selected 
chunk can be performed at the same time that the chunk is being 
authenticated. In this way, rendering of the individual chunk can begin almost 
^ immediately. Also, it is noted that in a less secure implementation, one could 

H io also render a chunk prior to checking the hash and if the hash check fails, 

FU stop rendering all subsequent chunks. 

ft] 

y. Block diagram 195 of FIG. 10 presents a more pictorial 

HJ representation of the verification flow of FIGs. 9 and 4. First, the hash table 

entry of a chunk, shown as Chunkl in this example, is recalculated to yield a 
q is recalculated chunk hash Hash'(Chunkl); this corresponds to Block 182. Next, 

\% the recalculated chunk hash Hash'(Chunkl) is compared to the Chunkl hash 

Iff 

Q entry in hash table 142 to see if there is a match, as shown in Block 184. If 

the hashes agree, this indicates that the authenticity of a chunk is verified and 
rendering of the chunk can begin. Finally, this process is repeated for each 

20 chunk of the content. 

It is noted that this process is independent of the type of data being 
hashed. If the data were unencrypted or not part of a content package, the 
same process would be applicable. The inventive concepts of chunking the 
data and creating a hash table are independent of the type of digital content 

25 being processed. 

Block diagram 200 of FIG. 11 illustrates an exemplary system block 
diagram of the present invention. Generation block 210 is analogous to the 
functionality illustrated in Block 110 of FIG. 4, while verification block 240 is 
analogous to the functionality illustrated in Blocks 150-194 of FIG. 4. Content 

30 12 is provided to generation block 210 where it is optionally encrypted and 
divided into chunks of content 144, which, together with hash table 142 and 
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CCerf certificate become part of secure content package 140. The chunked 
data content, together with hash table contents 142 and CCert 20 are 
provided to verification block 240 via some communication medium, such as a 
server or the Internet. Verification block 240 resides within or is coupled to a 

5 user device 230, such as a pager, a mobile phone, PCS device, BlueTooth 
device, an automotive entertainment system, set-top box, or home computer 
(PC), for instance. Verification block 240 contains the functionality needed to 
verify the authenticity of the hash table and, if appropriate, the authenticity of 
the individual chunks of content prior or subsequent to rendering. It is 

10 understood that the functionality of generation block 210 as well as verification 
block 240 may be implemented in hardware, firmware, software, or any other 
process capable of providing the disclosed functionality. 

The present invention is applicable to protecting digital content, even 
extremely large content files such as video in which the hash table can be 

15 very large. In this situation, calculating even the overall hash of the hash 
table be quite time consuming. This situation, however, can be addressed by 
the present invention by subdividing the hash table into chunks that are each 
subsequently hashed in their own right and added to a secondary hash table, 
with each secondary hash table corresponding to a hash table chunk. The 

20 secondary hash tables are hashed as described above in conjunction with the 
chunks. This scheme uses multiple layers of hash tables and preferably a 
single certificate to authenticate all of the hash tables and the content. 

One way of viewing this is to consider a hash table itself as input 
content to be processed by the method of the current invention. In this case, 

25 encryption of the content would not make sense, so that the content is hashed 
into a hash table without prior encryption. This process can be repeated as 
many times as necessary to get the final hash table down to a small enough 
size. Expanding the authentication for content with multiple hash table layers 
follows the same general pattern of authenticating the main hash table and 

30 then chunks of the smaller hash tables/content as required. Preferably, this is 
all performed concurrently with the rendering of the original content. 
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This approach is further illustrated in FIG. 12. The original content, in 
this case a very large content block 300 has been divided into a plurality of 
chunks Chunkl, Chunk2, Chunk3, Chunkn. Using the approach of the 
present invention, previously described above, these chunks are processed to 
produce a very large Hash Table I 310 with hash table entries Hashl.1, 
Hashl.2, Hashl.3, ...Hashl.n that can be stored as part of the content 
package. This is representative of the flow of Blocks 112-116 of FIG. 5. 
Since the size of Hash Table I 310 produced by the present invention is still 
prohibitively large, it can in turn be treated as content that is itself chunked 
and hashed in accordance with the present invention. Thus, the chunks of 
Hash Table I 310, Chunkl. 1, Chunkl. 2, Chunkl. 3, Chunkl.m are hashed to 
produce Hash Table II 320. That is, Chunkl.1 consists of Hashl.1, Hashl.2, 
Hashl.3, ... until a chunk is reached. This corresponds to repeating Blocks 
114-116 of FIG. 5. Thus, the hash of Chunkl.1 is Hashll.1, the first entry in 
Hash Table II 320 and the hash of Chunkl.m is Hashll.m, the last entry in 
Hash Table II 320. In this example, Hash Table II is small enough to be 
completely hashed quickly, such as before rendering of content begins. The 
rest of the generation process that follows is as described above for the non- 
iterated approach in that the overall hash of Hash Table II 320 can be 
calculated (as in Block 118 of FIG. 5) and included in the certificate which can 
then be signed (Block 120 of FIG. 5). Again, chunking and hashing a hash 
table itself may be performed as often as needed to obtain the right size hash 
table suitable for allowing an adequately swift hashing process during the 
subsequent verification process outlined in Blocks 150-190 of FIG. 4. 

The verification process of the iterated approach for this particular 
example is somewhat similar to the verification process set forth in FIG. 4. 
Hash Table II is hashed to provide a recalculated value which can then be 
checked against the previously calculated and expected value stored in the 
signed certificate. If there is a match, the process continues. Next, the first 
chunk of Hash Table I, Chunkl.1, is hashed and its hashed value is compared 
against the expected and corresponding value stored in Hash Table II. If 
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there is a match, then the first chunk of content is hashed. This hash value 
then is compared with the expected and corresponding value Hashl.l in Hash 
Table I, Chunkl.1. If they match, the first chunk of content is authenticated 
and can be rendered. The next step is to hash the second chunk of content 
and compare it with the value Hashl.2 in Hash Table I. The process 
continues for each chunk of content and each chunk of Hash Table I. 

While the invention has been described in conjunction with specific 
embodiments, it is evident that many alternatives, modifications, permutations 
and variations will become apparent to those of ordinary skill in the art in light 
of the foregoing description. Accordingly, it is intended that the present 
invention embrace all such alternatives, modifications and variations as fall 
within the scope of the appended claims. For instance, it is noted that the 
present invention is applicable to portable, wireless devices such as pagers, 
mobile phones, PCS devices, and BlueTooth devices characterized as having 
a limited communication range, as well as to devices that are not necessarily 
mobile or wireless, such as automotive entertainment systems, set-top boxes 
that handle digital content, and home computers. 

What is claimed is: 



DOCKET NO. CR00287M 



13 



